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_2 Abstract 

IL" This paper is concerned with the variational inequaUty problem 

•^ F/P(J", Fix (T)): find u G Fix (T) such that {J='{u),z - u) > for all 

rN z G Fix(T), where T : M" — )■ M" is quasi-nonexpansive, Fix(r) is its 

C^ nonempty fixed point set, and J-" : M" — t- M" is monotone. We propose, 

in particular, an algorithm which entails, at each step, projecting onto 
a suitably chosen half-space, and prove that the sequences it gener- 
ates converge to the unique solution of the VIP. We also present an 
application of our result to a hierarchical optimization problem. 
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1 Introduction 

The classical variational inequality problem (VIP) is to find a point x* & S 
such that 

(J^(x*),x-x*) > Ofor allxG ^, (1.1) 

where S" C M" is nonempty, closed and convex, J-" : M" — )■ M" is a given 
operator, and (■,■) denotes the inner product in M". This problem, denoted 
by VIP(J-', S"), is a fundamental problem in Optimization Theory because 
many optimization problems can be translated into VIPs. The VIP was 
intensively studied in the last decades; see, e.g., the two- volume book by 
Facchinei and Pang [20], and the review papers by Noor [30] and by Xiu and 



Zhang [32]. Some algorithms for solving (1.1) fit into the framework of the 
following general iterative scheme: 

x'^'=Ps{x'-rkJ'{x')), (1.2) 

where r^ > and Ps is the metric projection operator onto S (see Auslender 
[2] and consult [20], Volume 2, Subsection 12.1] for more details). 

Such methods are particularly useful when the set 5* is simple enough to 
project onto. However, in general, one has to solve a minimization problem 
(evaluation of the metric projection onto S) at each iterative step in order 



to get the next iterate. In this case the efficiency of method (1.2) may be 
seriously affected. Fukushima [22] developed a method that overcomes this 
obstacle by replacing the metric projection onto the set S" by a subgradient 
projection which is easier to calculate. Censor and Gibali present in [2] the 
(5-algorithmic scheme which generalizes the Auslender and Fukushima algo- 
rithms in the sense that there is some "freedom" in choosing the hyperplane 
onto which one projects. 

In this paper we present a natural extension of this (5-algorithmic scheme 



(Algorithm 3.7 below). Given an operator T : M" — )■ M", we denote by 
Fix(T) := {x G M" | T(x) = x} the fixed point set of T. It is well known that 
Fix(T) is closed and convex if T is quasi-nonexpansive (see, e.g., 0, Proposi- 



tion 2.6 (ii)]). Observe that the feasible set 5" of the VIP in (1.1) can always 
be represented as the fixed point set of some operator, say, S = Fix (P5). 
Following this idea, Yamada and Ogura [M] considered the variational in- 
equality problem VIP (J-", Fix(T)), which calls for finding a point x* G Fix(T) 
such that 

{Tix*),x -x*)>0 for all x G Fix(T). (1.3) 



In the case where T is quasi-nonexpansive and so-called quasi-shrinking, an 



algorithm for solving (1.3) in a real Hilbert space was proposed in [3l] under 
the conditions of Lipschitz continuity and strong monotonicity of J-". The 
iterative step of the method is as follows: 



a;'=+^=T(a;'^)-A,+i^(T(a:'^)), (1.4) 

where {Afcj^Q is a nonnegative sequence which satisfies certain conditions. 



As a matter of fact, Yamada and Ogura J3H Theorem 5] showed that (1.4) 
could be applied to more general cases with weaker monotonicity assump- 
tions, such as paramonotonicity (see e.g., [35]). 

In this paper we present a method for solving the VIP (J-", Fix(T)) when 
the operator T is merely quasi-nonexpansive. This method generalizes the 
earlier results of Auslender and Fukushima, as well as the (5-algorithmic 
scheme. In addition, we present the relationship between our algorithm and 
the Yamada-Ogura method. Note that several authors have considered the 
VIP(J-', Fix(T)) for a quasi-nonexpansive operator T and proposed methods 



similar to (1.4), where T is replaced by a sequence of quasi-nonexpansive 
operators T^ with the property Fix (T) C f]f.yQ Fix (T^) (see [3l [131 1261 ^^)- 
Our paper is organized as follows. Section |2] is devoted to some definitions 
and preliminary results. Our algorithm is described in Section |3] and analyzed 
in Section |4| Finally, in Section |5] we present an application of our results to 
a hierarchical optimization problem. 



2 Preliminaries 

In this section we recall some definitions and properties of several classes of 
operators. 

Definition 2.1 Let T : M" -^ M" be an operator with a fixed point. The 
operator T is called: 

(i) a-strongly quasi-nonexpansive (a-SQNE), where a > 0, if for all 

(x, w) G M" X Fix(T), we have 

||T(x) — u;|| <||2; — wll — a ||a; — T (a;)|| ; (2.1) 

If a > 0, then we say that T is strongly quasi-nonexpansive (SQNE); 



(ii) Firmly quasi-nonexpansive (FQNE) if it is 1-SQNE; 
(iii) Quasi-nonexpansive if it is 0-SQNE, i.e., 

\\T{x) -w\\< \\x-w\\ for all {x,w) G M" x Fix(T); (2.2) 

(iv) Nonexpansive if 

\\T (x) -T{y)\\<\\x- y\\ for all x,y e M". (2.3) 



The class of quasi-nonexpansive operators was denoted by Crombez [181 
p. 161] by J^^. An important subset of J-"", namely the T-class operators, 
was introduced and investigated by Bauschke and Combettes ^, and by 
Combettes [T7j. The operators in this class were named directed operators in 
Zaknoon [36] and further used under this name in [16] . Cegielski [10] studied 
these operators under the name separating operators. Since both directed 
and separating are key words of other, widely-used, mathematical entities, 
Cegielski and Censor have recently introduced the term cutter operators [12] , 
or cutters in short. This class coincides with the class J-"^ (see [E]), with the 
class of 1-SQNE operators (see [HI Theorem 2.1.39]) and with the class DCp 
for p = — 1 [29j. The term firmly quasi-nonexpansive (FQNE) for T-class op- 
erators was used by Yamada and Ogura [331 IMl Section B] and by Maru§ter 
[28j . This class of operators is fundamental because it contains several types 
of operators commonly found in various areas of applied mathematics, such 
as the metric projections, subgradient projections and the resolvents of max- 
imal monotone operators (see [5]). The formal definition of the T-class in 
Euclidean space is as follows. 

Definition 2.2 An operator T : W' ^ M" is called a cutter (T G T) if 
Fix(T) ^ and 

(T (x) -x,T{x)-w) <0 for all (x, w) E M" x Fix(r). (2.4) 

For x,y G M", we denote 

H{x, y) := {m G M" I (m - J/, X - y) < 0} . (2.5) 

If X 7^ y, then i!f (x, y) is a half-space. It is easy to see that T is a cutter if 
and only if 

Fix(T) C H{x, T(x)) for all x G W. (2.6) 

This property is illustrated in Figure [ij 




Figure 1: Property of cutters 



Definition 2.3 Let T : M" ^ M" be a cutter and a E [0,2]. The operator 
Ta := I + a(T — I), where / denotes the identity operator, is called an 
a-relaxed cutter. 

Bauschke and Combettes [3] established the following two properties of 

cutters. 

(i) The set Fix(T) of all fixed points of a cutter operator T is closed and 
convex because 

Fix(T) = n,.eMnif(x,r(x)). (2.7) 

(ii) If T e T and a G [0, 1], then T„ G 1. 

One can easily verify the following characterization of a-relaxed cutter 
operators U {U = Ta): 

a{U{x) -x,w-x)> \\U{x) -xf for all {x,w) G M" x Fix(T). (2.8) 

Theorem 2.4 Let a G (0,2]. An operator U : W" -^ M."' is a cutter if and 
only if Ua is ((2 — a) /a) -strongly quasi-nonexpansive 

Proof. See, e.g., [IZl Proposition 2.3 (ii)] and [HI Theorem 2.1.39]. ■ 

Notation 2.5 Let C be a nonempty, closed and convex subset of MJ^, and 
let T: W^ ^^ M" be quasi-nonexpansive. 



(i) The distance function of a point x G M" to C is defined by 

dist(a;, C) := inf{||x - z\\ \ z e C}. (2.9) 

(ii) For r > we define the subsets 

C^ := {u e W I dist(M, C) > r} (2.10) 

and 

Cr := {u e W I dist(M, C) < r}. (2.11) 

(iii) Define the function D: [0, oo) — ?■ [0, oo] in the following way: 

inf (dist(M, Fix(r)) - dist(T(M), Fix(T))) 

M6(Fix(T))'TlC 

D{r) := <j if (Fix(T))'- H C 7^ 0, 
+00, otherwise. 

(2.12) 

(iv) Denote the metric projection onto Fix(T) by R, i.e., R := PFix(T)- 

It is well known that, for a convex subset C, the (continuous) distance 
function dist(-,C) is convex. Consequently, Cr is closed and convex as a 
sublevel set of a convex function. The continuity of dist(-,C) implies that 
the subset C is also closed. 

In what follows we assume that T : M" — t- M" is quasi-nonexpansive and 
C C M" is a closed and convex set such that Fix(T) fl C 7^ 0. 

Parts (i) and (ii) of the following theorem can be found in [311 Lemma 2] . 



Proposition 2.6 The function D : [0, 00) — ;■ [0, 00] defined by (2.12) has 
the following properties: 

(i) D{0) = and D{r) > for all r > 0; 
(ii) if ri > r2 > 0, then D{ri) > D{r2); 
(iii) L>(dist(x, Fix(T))) < ||x - T (x) || for all x^C. 



Proof, (i) Let r > 0. We prove that D{r) > 0. The inequahty is clear if 

(Fix(T))'^nC = 0. Now suppose that (Fix(T))'^nC ^^ 0. Then the definition 
of the metric projection and the quasi-nonexpansivity of T yield, for any 

X e (Fix(T))'- n C, 

||x - R (x) \\-\\T (x) -R{T (x)) II >\\x-R (x) \\ - \\T (x) - R (x) \\ > 0. 

(2.13) 
Consequently, D{r) > 0. Let x G Fix(T) fl C. By the quasi-nonexpansivity 
of T, we have T (x) = x and 

D{0) <\\x-R (x) II - ||r (x) -R{T {x))\\ = 0, (2.14) 

which together with the first part proves that -D(O) = 0. 

(ii) Let Ti > Ti > 0. Then, of course, {Fix{T)Y^ C [Fix(T)Y'^ and so the 
property is clear. 

(iii) Let x E C and r = dist(a;, Fix(T)). If r = 0, then T (x) = x and, by 
(i), the assertion is obvious. Let r > 0. Then, of course, x G (Fix(T))'" fl C 
and, by the definition of the metric projection and the triangle inequality, 
we have 

D{r) < \\x-R{x)\\ -||T(x)-i?(T(x))|| 

< ||x-i?(T(x))|| -||T(x)-i?(T(x))|| < ||,T-T(x)||, (2.15) 

and the proof is complete. ■ 

Now we give two equivalent definitions of a quasi-shrinking operator. 

Definition 2.7 (cf. [34J) Let C C M" be closed and convex, and let 
T : M" — )■ M" be a quasi-nonexpansive operator. The operator T is called 
quasi-shrinking on C if D{r) = <^ r = 0. 

Definition 2.8 Let C C M" be closed and convex, and let T : M" -> M*^ be 
a quasi-nonexpansive operator. We say that T is quasi-shrinking on C if 
for any sequence {ti'^j^Q C C, the following implication holds: 

lim (11?/ - R (n^) II - ||T (u^) -R{T {u'')) ||) = ^ lim \\u''-R {u'') \\ = 0. 

(2.16) 

Proposition 2.9 LetC C M" he closed and convex, and let a quasi-nonexpansive 
operator T : M" ^ W he such that Fix(T) n C ^ 0. Then Definitions ^n\ 
and 12.81 are equivalent. 



Proof. Let T be quasi-shrinking in the sense of Definition 2.7 and choose 
{u^}^o — ^- Suppose that hmfc_i>oo \\u'' — R {u'') \\ ^ 0. Then there exist 
a constant e > and a subsequence {u^^^f^^ C {m'^j^q such that ||u^-'' — 
R (m^'j) II > e. Therefore u^^ e (Fix(T)Y D C and we have 

inf (||«^^ - R (n^O II - r KO -R{T {u'^)) ||) 
> inf (||n-i?(n)||-||T(n)-i?(TH)||) 

MG(Fix(T))=nC 

= D(£) > 0. (2.17) 

Consequently, hnifc^oo (||m^ - R {u^) \\ - \\T {u'') -R{T {u'')) ||) 7^ if it 
exists. 

In the other direction, let T be quasi-shrinking in the sense of Definition 



2.8 Suppose that D(r) = for some r > 0. Then there is a sequence 



W^^Q C (Fix(T))^' n C such that 



lim (||m'= - R (u^) II - ||T (u'') -R(T («'=)) ||) = 0. (2.18) 



By Definition 2.8, we have 



r < lim dist(M^ Fix(T)) = lim jlu'^ - i? (u'') \\ = 0, (2.19) 

fc— ^-oo fc— ^00 

i.e., r = and the proof is complete. ■ 



Definition 2.10 Let C C M" be closed and convex. An operator T : C ^ 

00 

'k=0 



is called closed at y G M" if for any sequence {a;'^}, C C, we have 



( lim x'' = X G C and lim T(a;^') = y) ^ T{x) = y. (2.20) 

We say that the closedness principle holds for an operator T : C — ?■ M" if 
/ — T is closed at (see [8j), i.e., 

f limx'' = x e C and lim ||T(x^) - x''\\ = o) ^ x e Fix (T) . (2.21) 

It is clear that in M" a continuous operator, in particular a nonexpansive 
one, satisfies the closedness principle. Later in this section we give other 



examples of operators satisfying the closedness principle (see Examples 2.14 



2.19 and 2.22). 



Proposition 2.11 Let C C M" &e closed, bounded and convex and let T : 
M" -^ M" be an operator with Fix(T) n C ^^ 0. IfT is SQNE (equivalently, 
an a-relaxed cutter for some a G (0, 2)) and I — T is closed at 0, then T is 
quasi-shrinking on C . 

Proof. Let r > and D{r) = 0. Then there is a sequence {m'^J^q — 
(Fix(r))'^ n C such that 



lim{\\u' - Riu')\\ - Wnu') - R {T{u')) \\) = 0. 



(2.22) 



By the quasi-nonexpansivity of T, the definition of the metric projection and 



by (2.22), we have 

< Wu'' - R{u'')\\ - \\T{u'') - R{u'')\\ 
< \\u'' - R{u'')\\ - \\T{u'') - R {T{u'')) II -^ 0. 

Consequently, 

< ||m^ - R{u'')\\ - \\T{u^) - R{u'')\\ -^ 0. 
Since T is SQNE, there is a > such that 

||r(M^-) - R{u'')\\^ < Wu'' - i?(M^)f - a\\T{u'') - M^'f . 

Let z G Fix(T). By the boundedness of {w'^j^O' there exists d > such that 
\\u'^ — z\\ < d for all A; > 0. Using the definition of the metric projection and 
the quasi-nonexpansivity of T, we obtain 

Wu'' - R{u'')\\ + ||T(u'=) - R{u'')\\ < \\u'' - z\\ + Wu'' - Riu'')]] 

< 2||u^-2|| < 2ci. (2.26) 



(2.23) 



(2.24) 



(2.25) 



By (2.24), (2.25) and (2.26), we now have 



||T(n^)-u 



fc||2 



<-{\\u'-Riu')r-\\nu')-Riu')r) 

a 

'" ,k T3l„,k'\\\ \\'T'l„,k\ T3l „,k\\\\l W^M D/'n,'i■'^ll i \\'T'l,,,k\ T3l„,k 



a 
2d 



\u^ - R{u' 



Tm" 



R{u' 



< —iWu'' - R(u'')\\ - WTiu') - RU)\\) -^ 0. 
a 



u'' - R{u'')\\ + \\T{u'') - R{u' 

(2.27) 



Consequently, 

lim ||T(u'=)-m'=|| =0. (2.28) 

fc— ^-oo 

Since {■u'^j^o is bounded, there exists a subsequence {m'^j}°^o of {"^^jfcLo 
such that 

hm u^i = u*. (2.29) 

The closedness of / — T at yields that u* G Fix(T) and 

r < inf dist(u,Fix(T)) < lim \\u^^ -u*\\= 0, (2.30) 

Me(Fix(T))'TlC i^oo 

i.e., r = 0, which proves that T is quasi-shrinking, as asserted. ■ 

Remark 2.12 The converse to Proposition |2.11 is not true. To see this, 
take C = {u eW \ (a, u) < /3} for some a 7^ 0, /3 e M and T = 2Pc - ^■ 
Then T is quasi-shrinking, but T is not SQNE. 

The next lemma is taken from PH Lemma 1]. 

Lemma 2.13 Let f : [0, 00) — )■ [0, 00] be an increasing function such that 
f(r) = ^ r = 0. Let {6fc}^o ^ [0' ^) ^^ such that 

lim6fc = 0. (2.31) 

fc— >oo 

Then any sequence {a^j^Q C [0, 00) satisfying 

ak+i < Ofc - /(ofc) + &fc (2.32) 

converges to 0. 

Let C C M" be nonempty, closed and convex. It follows from the charac- 
terization of the metric projection that Pc is a cutter. Moreover, Pc satisfies 
the closedness principle as a nonexpansive operator. We now present more 
examples of cutter operators the complements of which are closed at 0. 

Example 2.14 Let [/ : M" — )■ W^ be an operator with a fixed point such 
that I — U is closed at {e.g., the metric projection onto a closed and convex 
set), and let T : M" -^ M" be a cutter such that Fix ([/) C Fix(T), which 
satisfies for any bounded sequence {x'^J^q C M" the following implication: 

lim \\T (x'') - xH = ^ lim \\U (x'') - x^'ll = (2.33) 

10 



{e.g., a cutter T such that ||r(x) — x|| > a||f/(x) — a;|| for some constant 

a > and for all x G M"). Then T is closed at 0. 

Indeed, let limfc_j.oo a;'^ = z and linifc^oo \\T (x'^) — a;*^|| = 0. Then {x''}f,^Q is 



bounded and, by (2.33), we have linifc-^oo ||f^ {x'') — x^|| = 0. Since I — U 
is closed at 0, we know that z G Fix(f/). Consequently, z G Fix(T), i.e., 
/ — T is closed at 0. An operator T having the properties described above is 
a special case of the sequence of operators considered in [3 Theorem 1] and 
in [121 Theorem 9.9]. 

Next we present two more examples of operators which are cutters and 
the complements of which are closed at 0. These examples are special cases 



of Example 2.14 



First we present several definitions. 



Definition 2.15 Let / : M"- — )■ M be a convex function. 
(i) The set 

df{y) := {(7 G M" : f{x) > f{y) + {g,x- y) for all x G M"} (2.34) 

is called the subdif f erential of / at y and any element of df{y) is called 
a subgradient and denoted by gf{y)- 

(ii) We denote by /<o the sublevel set of /, that is, 

/<o:={a;GM"|/(a;)<0}. (2.35) 

Definition 2.16 Let C C M". The indicator function of C at x is de- 
fined 

Ic{x) := ( ° '{^^ ^ ^' (2.36) 

[^ oo otherwise. ' 

Definition 2.17 Let C C M" 6e nonempty, closed and convex. We denote 
by Nq {v) the normal cone of C at v & C , i.e., 

Nc iv) ■= {d G M" I (rf, y - f ) < for all y G C}. (2.37) 

Remark 2.18 It is well known that d (Ic) = Ne- 



ll 



Example 2.19 Let / : M" — )■ M be a convex function with a nonempty 



sublevel set /<o (see (2.35)). Define an operator II/^p : M" — )■ M" by 

[ y it /(!/) < 0, 

where Qfiy) is a subgradient of / at y. The operator Il/^g is called the 
subgradient projection relative to /. 

For a subgradient gf{y), we denote 

L = Lf{y, gj{y)) := {a: G M" | /(y) + {gf{y),x - y) < 0}. (2.39) 

Lemma 2.20 Let f : M" — )■ M 6e a convex function and let y G M". Assume 
that /<o 7^ 0. r/ien t/ie following assertions hold: 

(i) /<o ^ -^- If gjiy) 7^ 0, t/ien L is a half-space, otherwise L = M". 
(ii) nj^p(?/) = Piiy) consequently, ^f^g is a cutter and Fix (LIj^q) = /<o. 
(iii) / — Ilj^g is closed at 0. 

Proof. See [H, Lemma 7.3], [I5l Lemma 2.4] and [TTl Lemma 4.2.5 and 
Corollary 4.2.6]. ■ 

The next class of operators was introduced by Aharoni et. al. in [T] 
for solving the convex feasibility problem. Later Gibali [21] and Censor and 
Gibali [H] used them for solving variational inequalities. 

Let C C M" be nonempty, closed and convex. Assume that C can be 
represented as a sublevel set of some convex function c : M" — ;■ M, that is, 

C = {xeR"\ c{x) < 0} . (2.40) 

Given a point z G M" and a positive real number 6, we define for z ^ C the 
ball 

B{z, Sc{z)) := {x G M" I \\x - z\\ < Sc{z)} . (2.41) 



For x, y G M" we consider the set H{x, y) as in (2.5) and define 

As{z) := {y G M" I C C H{z, y) and int B{z, 5c{z)) n H{z, y) = 0} . (2.42) 
We also need to impose the following condition. 

12 



Condition 2.21 Given a set C C M", described as in (2.40), we assume 
tliat for every z ^ C, 

5(z,5c(z))nC = 0. (2.43) 



Every convex set C can be described by (2.40 ). We may take, for example, 
c{z) = dist(z,C). In tliis case Condition 2.21 always holds for 6 G (0, 1). 



Example 2.22 Given a nonempty, closed and convex subset C C M**, with 



the representation (2.40), and a real number 6 G (0, 1] such that Condition 



2.21 holds, we define the operator Tc,5 at any z G M" by 



PH{z,y){z) iiz^C, 

z a z e c, 



(2.44) 



where H{z,y) is built from any selection of y from As{z), and call it a C-5 
operator. 



Observe that the subgradient projector II/^q is a Tc,s operator; see ^T5\ 
Lemma 2.8]. The fact that any C-6 operator is a cutter operator follows 
from its definition. For the closedness of Tc^s — / at 0, see, e.g., [151 Lemma 
2.7]. Alternatively, we show that, for any bounded sequence {x'^J^q, impli- 



cation (2.33) is satisfied with T := Tc^s- 
is a convex function with C := {x G I 



Let U := Ur 



'■C<0' 

c{x) < 0} ^ 



where c : 



-)■ 



Then, follow- 



ing Lemma |2.20[ I — U is closed at and Fix (U) = C. Now, let {x'^j^o 



be bounded and let limfc^oo ||^c,5 {x'^) — a;'^|| = 0. Then, from the inequal- 
ity ||(5c(x'')|| < ||Tc,5 (x'') -x'"!!, it follows that limfe^oo c(a;'') = 0. Con- 
sequently, limfc_>oo dist(a;'^, C) = 0, by the continuity of c. We claim that 
limfc^oo ||f^ {x^) — x'"'!! = 0. Indeed, by the definition of the subgradient Qc 
and the Cauchy-Schwarz inequality, we have 



< c(x'=) = c(x'=) - c{Pc (x^)) < (^c(x'),x'= - Pc{x'')) 



< 



\gc{x 



\x 



Pc{x')\\ = \\g,ix')\\d\st{x'',C) 



and 



\\U{x^) -x^ 
Consequently, Ymvk^oo \\U (x^) 



<dist(x^C). 



\c{x^)\ 

hci.x'') 

x^W =0, as claimed. 



(2.45) 



(2.46) 
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3 The algorithm 

Let J" : M" -> M" and let T : M" -> M" be a cutter. We need to assume that 
the following conditions hold in order to prove the convergence of our algo- 
rithm. These conditions were assumed to hold in ^2] for solving VIP(J-', S") 



(see (1.1)). Furthermore, the first two of these conditions guarantee that 
VIP(J-', Fix (T)) has a unique solution (see [201 Theorem 2.3.3] or [271 Chap. 
I, Corollary 4.3]). 

Condition 3.1 T is continuous on (Fix(T))^ for some e > 0. 

Condition 3.2 T is a-strongly monotone on (Fix(T))^ for some e > and 
a > 0, i.e., 

{J-'{x) — J^{y),x — y) > a\\x — y\\ for all x,?/ G (Fix(T))^ . (3.1) 

Condition 3.3 For some q G Fix(T), there exist some /3 > and a bounded 
subset E C M" such that 

{T{x),x-q) >(3\\T{x)\\ for all x^^. (3.2) 

Condition 3.4 / — T is closed at 0. 



Remark 3.5 Conditions of the type of Condition |3.3| are commonly used 
in Optimization Theory (see, e.g., [2T1 Section 2.5 ] and [231 Section 8.3], 
where also examples of methods employing these conditions are presented). 
As it was observed by Fukushima in [22] , a sufficient condition for Condition 



3.3 to hold is that the vectors J-'{x) and x make an acute angle, which is 
uniformly bounded away from tt/2, as ||x|| -^ oo. Indeed, Let c G (0, 1) and 
r > be such that 

||J^(a;)|| ||x|| 

for ||x|| > r. Let /3 G (0, c), g G FixT and R > r he such that ^ + /3 < c. 
Then, for all ||a;|| > i? we obtain 

<^<^>- ^'-'^^{(wm-M)- iwlky m)) "-"'^'" ■ "^11 

>(c-^)l|-F(x)M|x||>/3||7-(x)||. (3,4) 



In addition, observe that Conditions 3.1 and 3.2 concern the behavior of J-'on 



(Fix(T))^, while Condition 3.3 deals with a rather global behavior. 
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Example 3.6 Let M" be equipped with the standard inner product (x, y) := 

x'^y, x,y e M", Ai,A2 G M be such that < Ai < A2. Let c e (0, A1/A2), 

a G M" and r := Ml±£^M. Define J^ : M" ^ M" by 
A1-A2C -^ 

arbitrary if ||x|| < r 



1 G{x){x — a) if ||x|| > r, 

where G{x) is a positive definite matrix with inf||^.||>r Amin(G'(x)) > Ai > 
and sup||^.j|>r Amax(G(a:)) < A2, where Amin(G(x)) and Aniax(G'(a:)) denote the 
smallest and the largest eigenvalue of G{x), respectively. We show, that J-' 



satisfies (3.3) for all x E M" with ||x|| > r. It follows from the inequalities 

||G(x)x||<||G(x)||-||x||=A^,.(G(x))||x|| 
and 

Amin(G'(x))||xf < X^G{X)X < Ai„ax(G'(x)) ||xf , 

the Cauchy-Schwarz inequality, the triangle inequality and the monotonicity 



of the function ^ -^ t^tjtitI for ^ > 0, that 



A2(5+||a!|) 

{J-'{x),x) {x — ayG{x)x x'^G{x)x — a'^G{x)x 



||J^(x)|| ■ ||x|| \\G{x){x — a)\\ ■ \\x\\ \\G{x){x — a)|| ■ ||x| 

\min{G{x))\\xf - ||a||Amax(G'(x))||x|| 



> 



Amax(G'(x))(||x|| + ||a||)||x| 



Ai||x|| — A2||a|| 
- A2(||x|| + ||a||) -^ 

for all X eW with ||x|| > r. If G(x) = G for all x G M", then J'(x) = G{x-a) 
and the unique solution of VIP (J-", G) is P^a := argmin^^^; ||a^ — o||g, where 
II ■ IIg denotes the norm induced by G, i.e., ||m||g = {u'^Gu)2. 

Let {p/cj^Q be a sequence of positive numbers satisfying 

00 
limpifc = and } pk = +00. (3.5) 

fc=l 

Algorithm 3.7 

Initialization: Choose an arbitrary initial point x'^ G M" and set fc = 0. 
Iteration step: Given the current iterate x^ , 
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(1) build the set H^ := H{x ,T{x )) and calculate the "shifted point" 

,._( x'^- PkHx'^)/mx'^) II if Tix'^) ^ 0, 
^ •" \ x'^ if^(x'=) = 0. ^'^•^^ 

(2) Choose ak G [/i, 2 — /i] for some fi G (0, 1) and calculate the next iterate 
as follows: 

x'^' = P^.iz'), (3.7) 

where Pa,. = I + ak{PHk "~ ^) ^md Ph,, is the metric projection of M" 
onto iffc. 

(3) Set k := k + 1 and go to step (1). 

Remark 3.8 Since T is a cutter, we have Fix (T) C Hj^. Observe that 



(3.7) has an explicit form, because it is a relaxed projection onto a half-space 

^T(x'=)): 



k+1 T-, r k\ z" - ak- — „ ; Lr ,\u) [X -T [x^]) li z" 4 Hk, 

I z^ if z^ e Hk. 

(3.8) 



An illustration of the iterative step of Algorithm 3/7 is given in Figure |2] 
It is clear that 



if J^(x^) = 0. 
Therefore (3.5) yields limfc_^oo 1 1 -2'^ — x'^|| = 0. 



4 Convergence 



The following lemma is a consequence of Theorem 2.4, where P^^. is a relax- 
ation of Ph^i both defined in Algorithm 3.7 Nevertheless, below we present 



a complete proof of this lemma for the convenience of the reader. 

Lemma 4.1 Let y &W^ he arbitrary and let Uk G (0, 2). Then in the setting 
of Algorithm 13.71 we have 

\\Pa,{y)-w\?<\\y-w\\''-'^-^^\\PaAy)-y\? forallweYi^{T). (4.1) 

ak 
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Figure 2: Iterative step of Algorithm 3.7 



Consequently, 

dist(P„,(i/),Fix(r))2 < dist(y,Fix(T))2 - ^^^'^ii ^ ^-^ -112 



|P„,(l/)-yf. (4.2) 



Proof. Let w G Fix(T). Since Fix(T) C H^, the characterization of the 
metric projection yields 

{y-P^^(y),y-w) > \\P^^{y) - yf = \ \\p^^(y) - yf (4.3) 



at 



and therefore we have 



\Pady) - wf = \\y + akiPnAy) - v) - ^f 



y - wf + al WPu^y) - yf - 2afc {y - Pn^iy), y - w) 

2 2 — Ofc ., , , ,,2 



< ||y — W 



ftfc 



l^aft(l/)-l/|| • 



When we set w = PFix(T) (y) in (4.1), we obtain 



dist(P„,(y),Fix(T))2<dist(i/,Fix(r))2- ^ "'^"^ ^-^ -"2 



afc 



(4.4) 



\Pady)-yr (4.5) 



and the proof is complete. 
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Lemma 4.2 Assume that Condition 13.31 holds. Then any sequence {x'^J^q 
generated by Alaorithm \3.7\ is bounded. 

Proof. The proof is structured along the hues of [221 Lemma 3]. Let 
q G Fix(T), (3 > and a bounded subset E C W^ he such that (3.2) is 
satisfied. We show that, for sufficiently large k, we have 



||a;fc+l _g|| < ||a;fe _g| 



(4.6) 



i{ x^ ^ E and 

||a;fc+l_g|| < ||a;fc_g|| +p (4.7) 

otherwise, where p = sup^^pfc- This implies that {x^}^q is bounded. If 
J^{x^) = 0, then x'^ = z^. By the definition of x^^^ and Lemma 



4.1 



4.1 



applied 

to y := z^, w := g, inequality ( |4.6| ) is satisfied. Now assume that J^{x'') ^ 0. 
Lemma 



implies that, for each z G 



\Pa,{z'')-qf < \\z'' -q\ 



(4.8) 



Therefore 



|x^+^-gf < 



-2 






Pk 



m^' 



11-^(^^)11 

.{J^(x'),x'-q) + pl. 



I k l|2 

X - g 



(4.9) 



Thus, if X ^ E, we have, by (4.9) and Condition 3.3 



|a;fc+l_g||2 < ||2;« 



91 



2pfc/3 + Pfc = \\x' - gir - Pfe(2/3 - Pk). (4.10) 



Since pfe > and limfc_s.oo Pfc = 0, the latter inequali ty im plies ( |4.6 ), provided 
that /c is sufficiently large. On the other hand, by (4.8), the definition of z*^ 



(see (3.6)) and the triangle inequality, we obtain 

J^ix'') 



\x''+^-q\\ < 



y -q)-pk 



||.F(x^ 



< x" 



1\ 



pk, 



(4.11) 



i.e., (4.7) is satisfied. Hence {x'^J^q is indeed bounded as we have already 
observed. ■ 



Lemma 4.3 Assume that Condition 13.31 holds. Then any sequence {x'^J^q 
generated by Algorithm 13.71 satisfies 



lim dist(a;%Fix(T)) = 0. 

fc— >oo 



Proof. Recall that R := PpixiT)- Lemma 4.1 implies that 
dist(x'=+\Fix(r)) < dist(z^Fix(T)). 



(4.12) 



(4.13) 



If J^{x^) 7^ 0, then, by the triangle inequality, 

dist(^^Fix(T)) = \\z^ -R{x'')\\ = x'' - pk 

< ||a;''-i?(a;'')|| + pk 
= dist(x^Fix(T))+pfc. 



J^(a;* 



||^(a;'^ 



-i?(x^ 



If J^{x^) = 0, then x'^ = z^ and, consequently, 

dist(^^Fix(T)) = dist(a;^ Fix(T)). 

Therefore in both cases we have 

dist(x'=+\Fix(T)) < dist(a;^Fix(T)) +pfc, 

where 

^ _^ fpfc, if^(x^)^0, 

^"^ ■ jo, if J^(x'^) = 0. 



(4.14) 



(4.15) 



(4.16) 



(4.17) 



Define a^ := dist(a;'^, Fix(T)). Let C C M" be a bounded, closed and convex 
set such that {x'^J^q C C and Fix(T) fl C 7^ 0. The existence of such a set 
C follows from Lemma 4.2 By Proposition 2.6[iii)and Lemma 4.1 



D^{ak) = L'^(dist(a;^Fix(T))) < \\x'' - T{x 



k\\\2 



a 



2 W^ ^cikK^ 



k\\\2 



(4.18) 



< 



1 



ak (2 - ak) 



(dist(x^Fix(T)))^ - (dist(P„, (x'^) ,Fix(r)))' 



(4.19) 
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On the other hand, by the nonexpansivity of P^^, (3.9) and (4.17), we get 
Therefore 



Lets^ = i?(P„, (x'=)),i.e., 

\\PaS^') - s'W = dist(P„,(x'=),Fix(T)). 
Then, by the triangle inequahty, we get 



.k+l „k\ 



„fc+l 



|^«+i_^/c|| < ||3,'c+i_p^^^^. 



-fas, (3; ) S 



On the other hand, since s^ G Fix(T), we have 

dist(x'=+\Fix(T)) < ||x'=+^-s'=| 
From the last four inequalities we get 

„k+l 



(4.21) 



(4.22) 



(4.23) 



(4.24) 



ak+i < \\x''^'-Pad^l\\+distiPa,ix''),FixiT)) 



<p, + dist(P„,(x'=),Fix(T)) 



(4.25) 



or, equivalently. 



(dist(P„,(a;'=),Fix(T)))' > a^^ - p,' - 2p, dist(P„,(x'=), Fix(T)). (4.26) 



Using the above inequality for (4.19), we get for all /c > 0, 
1 



D\ak) < 



Oik (2 - ak) 



{al - al^, + p,2 + 2pk dist(P„,(x'=), Fix(T))) . (4.27) 



Now, by Lemma 4.2 , the sequence {x'^J^q is bounded and, therefore, so is 
{afcj^o- -^y Lemma 4.1 with y := x^, we have 



(dist(P„,(x^),Fix(T)))^ 



<||P,,(X'=)-Zf <||x'=-zf - ^ "'^IID ../c^ ^ku2^u^k .1,2 



C^k 



\Pakix'') -x'^lP < llx'"' - Z\ 



(4.28) 
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for all z G Fix(T). Taking z := R [x^^ in the above inequalities, we obtain 

dist(P„,(x'=),Fix(T)) < afc = dist(x^ Fix(T)). (4.29) 

Therefore the sequence {dist(PQ^(x'^), Fix(T))}^Q is also bounded. Since 
Ofc ^ [/^) 2 — /i] for some /z G (0, 1), we have 1/ {a^ (2 — a^)) < 1/ jj?. Denote 
hk := Pfc' + 2pfc dist(P„,(x^), Fix(T)). Using ^^, we get 



D'^{ak) < -^ {al - al+i + h) 

= ^ (flfc + O-k+l) i.C'k — C'k+l) H ^&fc- 



(4.30) 



Since {ofej^Q is bounded , we have l//i^ (a^ + a^+i) < M for some M > 0. 
By the definition of pk, limfc_>oo bk = 0. Hence 



1 1 

-—D (ak) < ak — dk+i H — ?rv^bk 



(4.31) 



and now we can apply Lemma 2.13 to conclude that limfc_s.oo dist(a;'^, Fix(T)) = 
0, which completes the proof. ■ 

Lemma 4.4 Assume that Condition 13.31 holds. Any sequence {x^}'^^q gen- 
erated by Alaorithm \'d.7\ satisfies 



lim ||x''+^ -x'^l 

fc— >oo 



0. 



(4.32) 



Proof. If J-'(x^) 7^ 0, then by the triangle inequality, the nonexpansivity 



of Paf. and by (3.9), we obtain for all k >0, 



\\X' 



fc+i_a;fc|| <\\x'+^ 



Po^Jx')\\ + \\Po^Jx') 



A\ 



\P^^(z^) - P^^(x')\\ + \\P^,{x') - x'W 



< Wz'' - x'^W + \\Pa,{x^) - x'' 

< Pk + akdist{x'',Hk), 



(4.33) 



where the latter inequality follows from ( 3.9[ ) and from the obvious equality 
Q;fcdist(a;'^,iJfc) = \\Pa^^{x'^) — x''\\. Since for all A; > 0, Fix(T) C H^, we have 



dist(x^/7fc) < dist(x^Fix(T)). 



(4.34) 
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Thus, 



x^^' -x''\\<pk + ak dist(x^ Fix(T)). 



In case J^{x^) = 0, we have 



\x'+'-x'\ 



afcdist(x^iffc) < afcdist(x^Fix(T)). 



(4.35) 
(4.36) 



By Lemma 4.3 and (3.5), we obtain the required resuh. 



Theorem 4.5 Assume that Conditions |3.1| — ["3^ are satisfied. Then any 
sequence {x'^J^q generated by Alaorithm \3.7\ converges to the unique solution 
X* of VIP{T, Fix (T)). 



Proof. Let x* be the unique solution of problem (1.3). By Lemma 4.3 



X G (Fix(T))e for all sufficiently large fc, where (Fix(T))£ is the set given 



in Conditions 3.1 and 3.2 (without loss of generality, e is the same in both 

(4.37) 



conditions). By Condition 3.2, we have 

(J^(x'=)-J^(x*),a;^-x*) >a\\x''-x*f 
and 



{T{x^) - T{x*),x^ - X*) = (J^(x'=), x^ - x'=+^) + {Tix^),x^+' - X*) 

-(J^(a;*),x'=-a;*). (4.38) 

Therefore 

{J^{x^),x''+^ - X*) > aWx'' - x*f + {T[x*),x^ - x*) + {J^{x^),x^+^ - x^). 

(4.39) 
Let A be an arbitrary positive number. Then we have 

{F{x*),x^ -x*)>-\ (4.40) 

for all sufficiently large k. Indeed. The inequality is clear if J^{x*) = 0. 



Assume now that ^{x*) ^ and let e := A/||J-'(a;*)||. By Lemma 4.3 
we have ||a;'^ — 2;'^|| < £ for all sufficiently large /c, where z^ = PFix{T)(x^ 
Consequently, 

{J^{x*), x^ - X*) = (J^(x*), z'' - X*) + {J^{x*),x^ - z^) 

> -\\T{x*)\\ ■ ||x^- - ^i > -||^(a:*)|| ■e = -X. 
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By the Cauchy-Schwarz inequality, 

(J-(a;'=),a;'^+^-x'=) > -||-F(x') 



I ^^+1 ^/c I 



(4.41) 



4.3 



From the boundedness of {x'^J^q (see Lemma 4.2) and from Lemma 
it follows, due to the continuity of T on (Fix(T ))g (Condition |3.1 ), that 
the sequence {J-'(x^)}^q is also bounded. Lemma 4.4 and inequality (4.41) 
guarantee that 

(J^(x'=),a;^+i-x'^) > -A (4.42) 



for all sufficiently large k. Applying (4.40) and (4.42) to (4.39), we obtain 

(J^(x'=),x^'+^-x*) >a\\x^ 



„*l|2 



x|r-2A (4.43) 

for all sufficiently large k. Divide the indices of {x'^J^q as follows: 

r := {A; > I 7{x^) = 0} and f := {A; > | J^{x'') ^ 0}. (4.44) 



Equation (|4.43|) implies, since A is arbitrary, that for k eT, 

X . 



lim x^ 

fc— >oo 



(4.45) 



We now show that the sequence {x'^j^gf contains a subsequence which con- 
verges to X*. To this end, let us consider the indices in T and suppose that 
there exist C > &^^d an integer k^ such that 



By Lemma [471 

„fc+l ™*l|2 



\X 



X 



\x^ - x*|| > C for all A; e r. A; > ko. 



2-«fc, 



(4.46) 



ip„,(z^) -x*r<\\z'-x*r- ^^^\\p^,{z') - z'r 



OCk 



x'' -Pk 



2-afc 



fc+i 



X 



k J^i^ 



||^(a;* 



\x'-x*e- 



^\uk+i_M_2 



Pk 



ak 



||^(x^ 



■(J-(a;'=),x'=-a;*) 



+^l^<^<^')-^^'-'>-4-^ 



. (4.47) 
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This is less than or equal to 



\x — X 



||^(x 



fe\ II {•'[^Jy^ ^ ) 



H-2^^^=^OT.'),.'«-.'>+«fl '-"' 



\\X X Z .. . , , .. [J' [X ),X X ) 

U{x'')\\ 
\ Ok J \\J^{x'')\\ 



2 / , 2 - Ctfc 



+ p, 1 -\. (4.48) 

V Oik J 

So, combining the above relations, we obtain 

lla^'^+i _ x*f < ||a;fc _ a;*||2 _ 2 J^^ (^(x^),x^+^ - x*) 



+ 2(^-^ + i)-^{:F{x%x'^'-x') 



2 / . 2 - ftfc 



Since {J-'(x'^)}^Q is bounded, there exists r > such that ||J-'(x'^)|| < r. 
Therefore, 

- 11^/,. II < --,for all k ef. (4.50) 

Since A is arbitrary, we can assume that 

2A < ^-aC. (4.51) 



By similar arguments as in derivation of inequality (4.42) and by the bound- 
edness of the sequence {(2 — 0;^) /afcj^Q, we can assume that, for all suffi- 
ciently large k, 

'^—^ + 1] (J^(x'=), x'^+^ - x') < \aC^ - 2A. (4.52) 

ak J 4 

Since Pk ^ and again using the boundedness of (2 — ak) /dk, "we can also 
assume that, for all sufficiently large k, 

(4.53) 



1- 
V 


2-ak^ 
"fc J 
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Applying (|443|, ^l2^ and d^SSJ) to dOgj), we get 

(«C' - 2A) 



\x 



,fc+i 



*I|2^II A; *||2 o 

X < X — X \\ — 2- 



Pk 



F{x^) 



+ 2 



Pk 



wn^m 



1 .2 ^^ OlC 



\q''^ T * 1 1 



Pk 



2 \\F{x^ 



raC^ + Pk 



2t 



(4.54) 



Combining (4.50) with (4.54), we get 



*ll2^^ll fc *ll2 

X < X — X 



Pfc- 



aC 



T 



(4.55) 



for all sufficiently large k. Thus there exists an integer fc G F such that 



Wk+l_^*n2^uk_^.n2 



Pk- 



T 



for all A; G r such that k > k. (4.56) 



By adding these inequalities ior k = k,k + 1, ...,A; + £ over /c G F, we obtain 

r 



a2 
I fc+^+l * II 2 ^ II A. *||2 '^'5 

X — X < x'' — X 



k&,k=k 



(4.57) 



for any £ > 0. However, this is impossible in view of (3.5). So there exists no 
C > such that (4.46) is satisfied. Therefore {x^j^^p contains a subsequence 



{2^^}fcef' f C f , converging to x*, i.e., there is a subsequence {a^^^j^gruf ^^ 
the whole sequence {x'^J^q which converges to x* . In order to prove that the 
entire sequence {x'^J^q converges to x*, suppose to the contrary that there 



exists a subsequence of {x }^q converging to x and x 7^ x*. By Lemma 4.4 



lim 



fe— >oo ll"^ 



fc+l 



-X 



0, therefore, there exists C > and an arbitrarily large 



integer j G F such that 



X" 



— X II > C c'-iid ||x-^ — a^ II > ||a^ 



X 



(4.5J 



However, if j is sufficiently large, we may apply an argument similar to that 



used to derive (4.56) and obtain the inequality 



x-' 



X < Wx-' 



X 



(4.59) 



which contradicts (4.58). Therefore the whole sequence {x'^J^q does con- 
verge to X*, as asserted. ■ 
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Remark 4.6 In [M] the operator T is assumed to be Lipschitz continuous 
and strongly monotone on the image of T, while here T is only assumed to 
be continuous on (Fix(T))^ for some e > 0. In |3H Theorem 5] Yamada and 
Ogura showed that the strong monotonicity of T could be weakened and 
replaced by the paramonotonicity. In [33] Yamada et al. applied successfully 



Algorithm (1.4) to the minimization of the Moreau envelope of nonsmooth 
convex functions, where only Lipschitz continuity and paramonotonicity were 
assumed. 



5 An application 

Given an operator / : M" — )■ M™, we would like to find its minimizers. Clearly, 
we cannot look for an optimal solution as defined for a scalar optimization 
problem [m = 1). Therefore we need to define a 'priori which solution concept 
is chosen. One might consider the lexicographic order, denoted by -<i^. This 
partial order is defined for x, y G M™ as follows: 

X ^L y '^ X = y OT Xk < Vk where k := min{i = 1, . . . ,m | Xj 7^ yi\. (5.1) 

Now consider the case where m = 2, i.e., / : M" — > M? , and denote by 
/j : M" — )■ M the z-th coordinate {i = 1,2) of the function /. Then our 
goal is to minimize / with respect to :<l- This problem is also called a two- 
stage or a bi-level or a hierarchical optimization problem. Before introducing 
the connection of this problem to our VIP, we recall some definitions and 
properties. 

Definition 5.1 Let A : M"- — ;■ 2"*" be a set-valued mapping. 

(i) A is called a maximal monotone mapping if it is monotone, i.e., 

{u — v,x — y) > for all u G A{x) and v G A{y), (5.2) 

and the graph G{A) of A, 

G{A) := {{x,u) G M" X M" I M G A{x)} , (5.3) 

is not properly contained in the graph of any other monotone mapping. 

(ii) The resolvent of A with parameter A is the operator J^ := {I + XA)^ , 
where / is the identity operator. 
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Remark 5.2 It is well known that for A > 0, 

(i) A is monotone if and only if the resolvent J^ of A is single- valued and 
firmly nonexpansive. 

(ii) A is maximal monotone if and only if J^ is single-valued, firmly 
nonexpansive and its domain is M", where 

dom(J^) := {x G M" I jf (x) ^ 0} . (5.4) 



m 



OeA{x)^xeFix{J^). (5.5) 



Example 5.3 Let C C M" be nonempty, closed and convex. The metric 
projection onto C is precisely the resolvent of the normal cone mapping, i.e., 

Pc = J^". (5.6) 

In addition, it is known that Nc is a maximal monotone mapping. 

Remark 5.4 Let C C M" be closed and convex. If a function g : M" — )■ M 
is convex, then 

X* e Argminj^f | C} ^==^ e dg{x*) + Nc{x*), (5.7) 

(see [25l Chapter VII, Theorem 1.1.1]). In the case where g is continuously 
differentiable, it follows from the first order optimality condition that 

X* G Argminj^f | C} <^^ x* solves VIP(V5', C), (5.8) 

see, e.g., [TJ Proposition 3.1, p. 210]. 

Remark 5.5 Both set- valued mappings, dg and Nc, are maximal mono- 
tone and dom (dg) = M", hence also dg + A''^ is maximal monotone (see [6l 
Corollary 24.4 (i)]) and therefore 

Oeidg + Nc)ix*) ^x* E Fix(jf +^^). (5.9) 

Let's go back to the hierarchical optimization problem: 

min{/2 I Argmin{/i | C}}. (5.10) 

Under the assumption of the convexity of fi : M" — )■ M, z = 1, 2, and the 



continuous differentiability of /2, problem (5.10) can be reformulated as 
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VIP(V/2,Fix(jJ-^i+^^)). That is, we look for a point x* E Fix(jf-^^+^^) 
such that 

(V/2(x*), x-x*)>0 for all x e Fix( jf ^+^^). (5.11) 

So, under appropriate assumptions on / : M" — ;■ M^, which assure that V/2 



satisfies Conditions 3J_ - 13.4[ we could apply Algorithm 3.7 

Next we present an example that can be translated into an appropriate 
VIP over the fixed point set of a cutter operator. 

Example 5.6 Let C C M" be closed and convex. Given a convex function 
(7 : M" — > M, we are interested in minimizing g over C so that the solution has 
minimal p-th norm, where p > 2. This solution is called a ]9-minimal-norm 
solution. 

Define the operator / = (/i, /2) : M" -> M^ by 

V p wWp "T 2 ii'ii2 / 

where ||-||p denotes the p-th. norm, i.e., ||x|| := (^"=1 kj|^) • Consider the 
following special case of problem (5.10): 



minimize -||x||^+ ^llxlln 

p \\ \\p 2 \\ IIZ 

s.t. X G Argmin{5f(x) | C}, 



(5.13) 



which is a regularization of the problem under consideration. Notice that 
/2 is a sum of convex and strongly convex functions and, therefore, V/2 is 
strongly monotone. 

For p = 2 we get that V(|||-||2) = /. Hence V/2 is Lipschitz con- 
tinuous on W^. Moreover, we do not need a regularization term to obtain 
strong monotonicity and we can set a = 0. Therefore we can use Yamada's 
and Ogura's hybrid steepest descent algorithm (see [SH Section 4]) to solve 
VIP(/, Fix( J;^^ '^)) and obtain a 2-minimal-norm solution. 

Let nowp > 2. In this case V(- \\x\\^) = (a;i|xi|^~^,X2|x2|^~^, ...,x„|x„|^~^) 
One can easily check that V- || ■ ||p is not globally Lipschitz continuous. There- 
fore we ca nnot use Yamada's and Ogura's algorithm. However, we can use 
to solve VIP(V(J \\-\\l + 1 \\-\\l),Fix{JJ^9+Nc^y To see this. 



3.7 



3.5 



Algorithm 

denote J^i :'^(^ |M|p, J^2 ■= V(f ||-f ) and J" := J^i + J'2. By Remark 
it suffices to show that (J-i(x),x) > c||J-i(a;)||2||x||2, for all ||x||2 > -R > 0, 
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i = 1,2, and some c G (0, 1). Notice that for i = 2 this inequahty holds for 
all c G (0, 1), because 

(J-2(x),x) = a\\x\\l = l|J'2(x)||2 ■ l|x||2. (5.14) 



For i = 1 the inequality is equivalent to 

which follows directly from 
and /3 := 1. By Remark 



^\\p) ^ C- |p||2p-2 ■ Iplh' (O.iOJ 



5.2 



jcmma 



6.1 (see the Appendix) with a := p — 1 
the operator T := J^f^ ^ is firmly nonexpan- 
sive and therefore it is a cutter. Moreover, J — T is closed at zero, by the 



nonexpansivity of T. Hence Conditions 3.1 - 3.4 are satisfied. 



6 Appendix 

Lemma 6.1 For any a,/3 > |, there is c E (0, 1) such that 



2 
n \ n n 



5^ix.r+M > cY,\^r ■Y.\'^^?' (6.1) 

,i=l / 1=1 i=l 

for all X eW. 

Proof. We have to show the following inequality: 

A\Z'^'>c\\x\\t-\\x\\f,. (6.2) 

The norms IHI2Q,, II "112/3 ^^^ IML+/3 ^^^ ^^^ equivalent; hence 

IfIL+/3 > c||x||2Q and IfUq+^j > c ||x||2_g (6.3) 

for some c > and all x G W\ Without any loss of generality, we can assume 
that ce (0,1). Then 

/'||^||"+/3y _ ||^||2" \\\\W > 2a+2/3|| ||2a ,| ||2/3 .^ .^ 

which yields our assertion. ■ 
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